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Abstract 
The purpose of this study was to examine the effects of questions 


on learning among mental ly handicapped children. The four types of 


. learning were Identified as relevant remembering, incidental remember - 


_tng, relevant inferring, and Incidental inferring. 


Results Indicated that question position was an important variable 


‘In Influencing the learning of educable mental ly retarded children, with 


eeraeone who received post-questions performing cons/stently better than 


chose who received pre-questions. A significant interaction between 


question type and relevant criterion type was also found; children who 


- 


received remember ing training questions scored higher ‘on the remembering 


‘relevant criterion test than children who had received inferring traln- 


Ing questions, and children received Inferring training questions 5 
performed better on the inferring relevant criterion test than children 


who had received remembering training questions. 


_— 


s : : 
INFORMATION PROCESSING AS A FUNCTION OF QUESTION: 
‘TYPE AND POSITION 


Research on mathemagenic behavior indicates that questions 
Interspersed in°prose may be used to reinforce specific study 
habits and may act to evoke -study behaviors (Faw & Walker, 1976; 
Rothkopf, 1970). The Impetus for these (sven tgations dealing 
with the Insertion of test questions in prose materials was pro- 
vided by Hershberger (1964) and Rothkopf (1966) as an extension 
of the commonly employed dreareimnad ideciuch ion principle of overt 


responding. Since these initial studies a fairly consistent pat- 


‘tern of results has emerged. Studies by Rothkopf '(1966, 1972), 


Rothkopf and Bisbicos (1967), Rothkopf and Bloom (1970), Frase 
(1967, 1968), Boyd (1973) and Snowmadfi and Cunn Ingham (1975) and 

a review by Faw & Walker (1976) support the following general con- 
clusions: 1) Inserted questions which appear before the material 
to which they relate (pre-quest ions) have a gpbstantial specific 
facilitative effect but no general fact iitattve effect, 2) Inserted 


questions which appear after the material to which they relate 


' (post-questions) have a substantial specific facilitative effect 


as well as a smal] genet facilitative effect on post-test scores. 
Thus it aiciears thik eiuuenbe wie able to adapt their study be- 
havior to the demands of these Interspersed test-like events. 

One of the sidaleit Vs teaching eantatiy handicapped Indi- 
viduals seems to be their difficulty in Identifying the important 


and critical features, of the material to be learned. Zeaman and 
ww : . 
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House’ (1963) have argued that the observed learning deficit of 
é retarded children may be accounted for by a lack of attention, 

and that the secret to teaching the retarded child lies In engineer- 
Thg his attention. Drawing on this work, Denny (1964) hypothe-: 
sized that the performance of mentally retarded children may be 

| due to a deficit in incidental learning, and contended that the 

- basic attentional webs Vid hypothesized by Zeaman and House (1963) 

‘may result in’ poor Incidental learning. Several experimenters 

: have reported results consistent with this, hypothesis teiees Gold- 
stein & Kass, 1961; Semmel & Williams, 1968). It was thus the fas 
tent of this study to examine the extent to wile different types | 
of questions placed in different positions weuid have both specific 


and general facilitative mathemagenic effects on the learning ‘of * 


retarded children. More specifically it was hypothesized that 


this effect would be additive (Boyd, 1973) tn effecting both the 
attention to and retention of the Information to be learned. 
Method 

Subjects 7 

Ninety intermediate level educable mentally retarded children 
served as subjects in this experiment. The 54 males and 36 females 
*tn the sample ranged in chronological age from 114 months to 168 
months (X= 141.60, SD = 10.90) with mental ages ranging from 74.48 
months to 132.88 months (KX = 98.42, SD = 13.10). The children 
were randomly selected from special education classes in each of 
the 11 cooperating schools after. the respective teachers had eliminated 


all children in their classes who had either hearing problems, speech 
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problems, or severe behavior problems. 


Materials 


The subjects listened to a short high interest-easy vocabulary 


‘mystery story of approximately 2400 words, which was divided into 


10 separate sections of approximately equal length. A reading of 
the story by a srotweslonal teller of chit ldren?s stories was re- 
corded on widto tape. | 

Each of the 10 sections fsa, a total of four questions, 
suave which required remembering and two inferring. The opera- 
tional definitions of these terms are davived from the work of 
Lynch and Ames (Note }). The most important distinguishing char-~ 
acteristic of remembering questions is that they call upon the 
child to recall something. He may ‘be asked for a straightforward 
summary of something or for a piece of information. They do not 
call upon the child to interprét or draw conclusions from data. 

Inferring questions are distinguished by the fact that they 
call upon the child to arrive at his own interpretations, deduc- 
tion, or conclusion from available information. A task in this 
category asks the child to ''go beyond the data'' and arrive si some 
sort of conclusion. The answer to one of the remembering questions 
and one of the inferring questions could be found in the first half 
of each section. The answer to the remaining remembering and 
Inferring questions could be found in the second half of each section. 

The criterion test was made up of two question types: re- : 


membering and Inferring. Each test was composed of 20 free recal] 


type Items in total, but each subject received only one type of test 


. / 


a 
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(1.e., either remembering or inferring, but in no case both). 

Each criterion test consisted of two subtests: a relevant and 
an incidental ‘subtest. The "'releyant'' qiestions were those which had 
been asked earlier during the atentng task and as such had. been 
heard by the sub ject once before. The incidental subtest questions 
were based upon the same story which the subject had listened to 
earlier, but were questions he had never heard before. All items were 
classified according to type by two people who had demonstrated con- 
sistent reliability with the Lynch-Ames (Note 1) category system. 


Procedure 


‘ 
ta 


Subjects were randomly selected from cooperating classreoms and 


" accompanied to the experimental room by Boe of the six experimenters. 


After establishing rapport with the subject, the experimenter intro- 
duced the story with the general statement) that the story was about a 
young boy who lives Ina city and the problems he has when he tries to 
catch some bank robbers. The subject was also told to expect a sur- 
prise ending. The experimenter stressed that !t was important to . _* 
listen carefully as he was interested in how much the subject jeacned 
from the story and that the subject would be asked questions after the 
story was over. ‘ " 

During the story the experimenter systematically introduced tiie 


questions. The questions were typed on a sheet of paper which the 


, & 
_experimenter held before him. The experimenters had been instructed 


to read the questions as they were printed. These questions were of 
two types (remember ing or inferring) and in one of two positions (pre- 


or post). In the pre-remember ing question condition, the questions 


7 
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were read to the Ss before each paragraph was heard, and the sub- 
jects were instructed to resporid to these questions orally after 
listening to each of cher paraucaslies No Informative Feedback was 
given. The experimenter gave only an indiscriminate, accepting 
response by saying ''Thank you'' or "'0.K.,'' but did not Indicate 
whether the answer was right or wrong. The pre-inferring questions 
group was asked one inferring question before each paragraph was 
heard and responded’ after they: heard the sareynanls In the post- 
question conditions the questions were asked one at a time, but 
after each section had been heard; the subjects responding immediately 
to the question. There were a total of ten paragraphs and, thus, ten _ 
questions. Control group subjects received no questions but did listen 
to the same short story. Instead, they had a short 20-secand break 
between each paragraph during which they just sat quietly. All sub- 
jJects' responses to all questions were tape-recorded and the experi- 
menter more down the subjects' dasponias verbatim as well. 

After the story was over, there was a |5-minute rest period 
during which the subject and experimenter played with Culsenaire Rods. 
Each subject was Informed before the 15-minute break that after they 
played for awhile, they would have a short test. 

After the rest period the experimenter administered the 20-item 
criterion test. Each of the questions was typed on a sheet of paper 
from which the experimenter, read the questions to the subject. The 
subjects' responses were again written down exactly as spoken. Each 
Item was read no more than two times in total. All questions and 


answers were also tape-recorded during this test period. 


g 
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Scot ing of the Tests 
A random sample of the seers which the experimenters wrote 
down were checked by two. people independently against the corres- 
ponding audio tape for accuracy of she written response. ideswlet. 
| as this showed the written response to be accurate more than. 99% a 
of the time, the scoring of the answers wai done on the basis of 
the responses which were written dowh by the esiaetucreers as op- 
posed to the taped wersion of ke subjects' Pee sanaue. 
The answers to each question were Judged in turn; I.e., all 
of the responses ae aiver question were judged before the answers 
to another question. Each ieucenak oak compared to that on the answer 
key. - The answer key was made up In advance of, any Judging and was 
‘based upon the information contained tn the story. Each response 
could receive ee three ‘possible scores. An answer which was 
completely correct earned 2 points, | point was given for half 
credit, and 0 points for an incorrect response. All of the answers 
were judged in such a way that the jodgé had no knowledge of the 
group to which the subject belonged. After all answers were judged, , 
an eatinate vf reliability was obtained by rescoring a random sample 
of answers. This produced 94.5% agreement between the first and 
second scoring: 
Results 
The results are orexeited here under two main headings: re- 
sults based upon the between trial scores, and results based upon 


the scores of the delayed criterion tests. 
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Between-Trials Scores 7 ] 
“A 2x2x2x6 ANOVA design with the location of Information in 
section factor as.a répeated measure was used to analyze the re- 
sponses given si the questions asked during the listening task. i 
The effects of quest ton type (T), question position (P), location 


of Information In section (1) and experimenter (E) were assessed, 


and are reported in Table |. 


The main effects of quest ton type (remembering and inferring) 
(F = 11.01, df = 1/48, p<.005) and question position (pre-and post) 
(F = 8.72, df = 1/48, p<.005) were significant. Those subjects 
who feceived remembering questions did significantly better (X = 16,87) 
than did those receiving Inferring questions (X = 7.78); and those 
subjects receiving post-questions scored significantly higher 
(X = 10.67) than those subjects who received pre-questions (X = 7.47). 
The two-way Interaction of question position (P) and location of 
Information in section (1) was also significant (F = 14.92, df = 1/48, 
pool), as was the three-way interaction of question type (T) with 
question position (P) and experimenter (E), (F = 4.20, df = 5/48, 
p<.005). se | 

Results of the planned comparison test (Snedecor & Cochran, 


1967) of the P x 1! interaction showed that subjects performed better 


on ttems-where they received a post-question and the information 


needed to answer the question was; in the last half of the section 


2 “i Q 1 
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than on items where they received a pre-question and the Information 
was In the first half of the section (p<.005). On items where 


_ tthe Information needed to answer the question was presented In the 


‘first half of the section, subjects who received post-questions per- 
iformed better than those who received pre-questions (p¢.05). On 
Items where the information needed to aiavee the question See 
¢sented In the last half of the section, subjects who received’a post- 
.question out-performed those subjects who had received pre-quéstions 
(p<.05). 
Delayed Criterion Test Scores 
Py These results are based on subjects' performance on the delayed 
(after 15-minute rest period) criterion test. There were 20 items 
on this criterion test. Ten of these items were "relevant" Items-- 
the quest Ions which were asked by the experimenter during the listen- 
1 Ing activity, and 10 were ''Incidental'' items--questions relating 
to the material covered in the story. but not asked during the listening » 
activity. Thus, the criterion test was composed of two subtests. 


Though the control groups received all 20 items as the criterion 


test, it must be pointed out that, in fact, they have no ieetevant't 
items as a result of their having received no training questions 
during the listening activity. The same situation exists for those 
groups who received one type of training question and another type 
of quest ion on the criterion test. Because the quest fons they re-. 
celved a the criterion test were of a different type than those 


/ they heard during the listening activity, they really have no 


"relevant" criverton test questions, elther. The term ''relevant,'' 


$ 
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= ‘ ; then, ts used. to describe a subset of 10 Ttems on the criterion 


- test and not any of the treatment conditions. The same applies 
for the term "Incidental'' which refers to the remaining set of 10 
Items. Table 2.contains the means and standard deviations of sub- 


jects’ performance on these delayed criterion tests. 


Four separate 2x2 ANOVA's were done on each of the four depend- 
ent measures: remembering relevant scores, remembering incidental 
scores, inferring relevant scores, inferring incidental scores. 


These data are reported in Table 3. 


The analysis of the scores of the relevant remembering and 
Inferring dependent varlables showed question type to have a signi- 
ficant effect in both cases (F = 8.48, df= 1/32, p<.0l for rele- 
vant remembering variable; F = 6.74, df = 1/32, p<¢.05 for relevant 
Inferring variable). An Inspection of the means showed that on the 
relevant remembering criterion test those subjects who received 
remember ing training questions out-performed those who received 
Inferring training questions. On the inferring criterion test, 
however, the results ware just the opposite--those subjects who 
received inferring training questions performing better than those 


_ 


who received the remembering training questions. No significant: 


a 


r 
4 
’ 
7s 
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: oa , effects were obtalned as a Eunee lon of the* ee position factor 
gee , on any, of the delayed dependent measures. The analysis of the In- ; 


: t 
eidental ‘séores on both the remembering and fnferrtng criterion 


tests showed no.significant différences.- 
.. °° The. results were further analyzed for all experimental and 
control groups with the analys!s of each criterion type done sep- 


arately. Results of these 5x2 ANOVA's (see Table 4) showed that 


subjects did best on the relevant. criterion items ‘Compared with 

the Incidental Items on both the remember ing (FE = h6. 42, of = 1/40, nd 
p<.001) and Inferring (F = 7.66, df = 1/40, p<.01) criterion tests. 

~ Though the analysis did not show any significant differences. on group. ‘ 
matin effect for either of the criterion tests, it did Indicate 
significant Interact Ion between, group and relevance of test on the 
remembering criterion test (F = 3.68, df = 4/ho, '%05). The: Newman- 
Keuls method of multiple compar isons (Winer, 1971), was used ‘to analyze hs 
this effect. Results.of this. comparison showsa that the-pre-quest ion 
remember ing training quest fon-renenbering ehiverton test relevant 

score was significantly higher dian all other relevant and incidental 
scores, ‘including the same type criterion test conker group, with 

the exception of the post-quest ion remember Ing training question 

remenber Ing criterion test group relevant score (p col). The. SPaRE™ 
Fémenkat tne EF mung quest lon-remember ing eriter fon test group . relevant 


score proved to be significantly higher than alt bf the incidental 


\ 
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géohes (p<¢.01) and higher than the ralavané score of the pre-question 
Inferring cruining aueatlon“vemebertng criterton test group (p<.05). 
Discussion | 

" The between-trials dats Suggests that question pos Teon is an im- 
“neiveaink variable in influencing the learning . ‘of educable mentally re- 
tarded children. As a main effect, subjects who reve ved post-questions 
performed Bones cenely better than those who received sparqianelanis 
This effect, thowsh significant, was in a direction opposite of what | 
was expected. lt was hypothesized that the pre-question condition would 
cue the subject to listen for the appropriate information (l.e., the 


« 


answer) and, thus, enhance his retention of the critical information. 


‘This effect, it was thought, would be superior to the effect of the 


expectation held by others who were recelving post-questions, that 
they would be asked a question about the section of the story they 
had just heard. 
" Moreover, it was thought that the subjects would perform better on 
trials where they received pre-questions and where the tnrarmaktoa was 


Close, i.e., In the last half of the section. The results. again indi- 


cated just the opposite. Subjects did better on ftems where they re- 


‘celved a post-question and where the ‘Information needed to answer the . 


‘question was in the last half of ‘the section. 


These findings were thought to be explained best by interference 


theory, with the better post-question performance of subjects being - 


” accounted for by the retroactive interference of the great amount of 


Informat lon presented after the question. Thus by the time the ex- 


perimenter called for the response to the ial tn the ¢ pre-quest ion 
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condition, the subjects may well have forgotten the question. 

Interference theory may also be used in explaining the interaction 
results siete me subjects ‘performed better on che items which were post- 
' questions and ‘dbata the information needed to answer the question was 
in the last! half of the section, than on any other combination of the 
“two seriusties A close look at the means for these groups shows that 
_ subjects did\best on items, where her was at least opportunity for In- 
terference; e worst where there was the-greatest opportunity for *inter- 
ference; and their performance was at a point in-between these. two groups 
when the opportunity for Interference was at a point half-way between 
these two extremes. | 

The significant interaction between Questtad type and relevant cri- 
terton type--that is, children who’ received remembering training-questions 


scored higher on ch remembering relevant criterion test than children 


' who had received’ — ering training questieis, and children who recelved 


Inferring train ingest ions partons better on the Inferring releyant 

" eriterton test wi e  Ai'ldren who had facerdea Tomer sng training questions 
“-was taken as s rt for the general thesis: that fas ectivitios astu- . 
dent engages in " '@n'co be Si with Instructional tasks “are of critical 
importance in st what he will learn'' (Anderson, 1970, p. 349). 

“In general, then, It) can “be said that the different types of questions 
may only be useful to the extent that a facilitate the "desired" kind 
of learning which must be defined In terms of a tencher's objectives for 

‘a particular lesson. | 


It is not geneitacely ‘clear, however, whether this effect - is a 


function a the fact iteting effect of the appropriate type question 


. 
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relative to the criterion task, or due to the suppressing effect of 


U 


the Inappropriate question type. A close Inspection of the means 
(Table 2) indicates that the inappropriate type question group per- 
’ formed slightly worse eiaii the control group in each case. Further 
reiearch Witt be: needed to clarify-this clouded issue. 
Z "Nevertheless, this significant iieavaerienattnet suggests -support 
for what Rosenshine and Furst (1971) have called the ''cognitive process" 
opportuni ty-to-learn phenomenon. This shanenenon refers to the import 
‘tant consideration of whether or not the level of the criterion in- 
Strument was relevant to, and of the same type as, the instruction. 
Though only the remembering criterion test Beaded a difference 
betissen the relevant experimental and the control grees this finding 
Is suggestive of the importance of teacher questions during instruction 
for’which the children have a reasonable erent iio for giving a correct 
Haapanse: The difficulty of the inkareing questions and ensuing, low.per- 


5 


centage of correct responses with accompanying low variance, likely con- 


tributed to the resultant nonsignificant difference between the relevant 
experimental groups and control on this criterion test. 
‘ The general conclusions from the data collected in this study are, 


then, that quest fons seem to be of value in the teaching of mentally 
handicapped children scat they are asked at the right time and with the 
right objective in mind. The right time is defined ae being In clos@ * 
temporat proximity to the presentation oF latoraattan and after the pre- 
sentation of this information. Furthermore, the questions seemed to be 
of greatest value when they were of the same type as the type of question 


se 
asked on the criterion test., 


1@° 
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ANALYSIS OF VARIANCE OF BETWEEN TRIALS TOTAL SCORES 
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' Table 2 


MEANS AND STANDARD DEVIATIONS OF DELAYED CRITERION TEST SCORES % 
. (Based on a possible total of 20 points) 


Irictdental 


Relevant 


Criterion Test 1 (Remember Ing) 

_ Remenber ing Pre-Questions 
Remembering Post-Questions 
inferring Pre-Questions 
Inferring Post-Questions 
Control (No Questions) 

Criterion Test 2 (Inferring) 

Remembering Pre-Questions 

Remembering Post-Questions 

Inferring Pre-Questions 

> 


Inferring Post-Questions 


Control (No Questions) 


(22 


Question Type and Position Effects ‘ 
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Table 3 


2x2 ANOVA'S ON DELAYED CRITERION SCORES 
WITHOUT CONTROL GROUPS 


if : Relevant Remember ing , 
Question Type (Q) B.bBae 
Question Position (P) <| 
Qx P 1.34 


Error 


Question Type (Q) 
Question Position (P) 
QxP 

trror 


41 


Question Type (Q) 6.7 
' Question Position (P) © <1 
Qx P <1 

€rror 


Question Type (Q) 
Question Position (P) 
Q x P 

Error 


Question Type and Position Effects 
. 21 
Table 4 


ANALYSIS .OF VARIANCE OF REMEMBERING AND INFERRING 
CRITERION TEST SCORES WITH CONTROL GROUP 


Remember ing Criterion Test : : 


Group (G) 


Relevance of Test (R) <.001 
Error $(G) 

GxuR. ; ' £.05 
Error SR(G) 


Inferring Criterjon Test 


Group (6) n.s. 

Relevance of Test (R) <.01 
Error S$(G) ‘ 

GxR ‘ 


Error SR(G) 


